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ABSTRACT 

In  this  report  we  consider  the  concept  of  operators  "equivalent  in  norm" 
and  its  use  in  understanding  preconditioning  for  singularly  perturbed  elliptic 
problems. 
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SIGNIFICANCE  AND  EXPLANATION 


The  classical  iterative  methods  for  the  solution  of  the  large  systems  of 
linear  equations  which  arise  in  the  numerical  solution  of  elliptic  boundary 
value  problems  become  less  efficient  as  the  size  of  the  system  increases,  i.e 
as  the  numerical  approximation  gets  better.  This  problem  is  particularly 
acute  for  singularly  perturbed  elliptic  operators. 

If  one  can  find  an  appropriate  "preconditioner"  this  difficulty  can  be 
either  ameliorated  or  eliminated.  Previous  research  in  this  direction  has 
been  limited  to  the  special  case  where  the  symmetric  part  of  the  operator  is 
positive  definite.  In  this  report  we  comment  on  current  efforts  to  resolve 


the  general  problem. 


PRECONDITIONING  FOR  SINGULAR  PERTURBATION  PROBLEMS* 

Seymour  V.  Parter 

1  ■  Introduction 

The  numerical  solution  of  elliptic  boundary-value  problems  leads  to  the 
related  problem  of  actually  obtaining  the  solution  of  a  large,  sparse  system 
of  linear  equations 

AnU  -  f  (1.1) 

where  An  is  an  n  x  n  matrix  with  n  *  0(h“2).  There  is  a  large  literature 
connected  with  the  analysis  of  iterative  methods  for  the  solution  of  (1.1)  - 
see  [181,  [19]. 

Almost  all  iterative  methods,  including  the  multigrid  methods  [14]  can  be 
cast  in  the  framework  of  a  preconditioning  followed  by  iterative  improvement. 
With  the  practical  success  of  multigrid  methods  for  uniformly  elliptic 
problems  with  positive  real  part  there  is  especial  interest  in  preconditioned 
iterative  methods  for  which  the  condition  of  the  preconditioned  system  is 
bounded  independent  of  the  mesh  spacing  ( i . e .  the  dimension  n  of  (1.1))  for 
sufficiently  fine  meshes.  In  that  case  one  can  easily  develop  iterative 
methods  that  yield  estimates  of  the  form 

,ej|  <  Kotk^l‘^,e°11 

where  k  -  c  or  c1^2  (c  «  condition  (B”'a  ))  depending  on  the 
implementation.  In  particular,  several  authors  [1],  [3],  [6],  [8]  have 

*This  report  was  presented  at  the  BAIL  IV  Conference,  July  7-11,  1986 
Novosibirsk,  Akademgorodok ,  USSR. 
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suggested  preconditioned  iterative  methods  where  the  preconditioner  B~ *  is 
the  inverse  of  the  discretization  of  a  separable,  positive  definite  elliptic 
operator.  In  the  special  case  where  the  domain  is  a  rectangle  the  separable 
problem  can  be  solved  by  fast  direct  solvers  [16],  [17] .  Others,  e.g.  [13], 
have  considered  using  several  iterations  of  a  classical  positive  definite 
stationary  one-step  iterative  method  which  is  either  consistent  with  the 
problem  at  hand  or  another  (usually  separable)  elliptic  problem. 

In  all  those  cases  both  operators  have  positive  definite  symmetric  part 
and  one  can  analyze  the  efficiency  of  the  preconditioned  iterative  method  by 
using  the  concept  of  "Spectrally  Equivalent  Operators"  introduced  by  D'Yakanov 
[7]. 

In  this  report  we  are  concerned  with  singularly  perturbed  elliptic 
operators  of  the  form 


Lfcu 


-*2 


2 
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i,j-1 


aij(x) 


3u 

dx 


+  e 
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2 

l 

i*1 


b^x) 


3u  ,  .  . 

3 ~  +  a0<x>u 


(1.2a) 


and 


specified  boundary  conditions  , 

where  0  <  e  «  1,  x  «  (x1#x2)  and  r  =  0  or  1  depending  on  the 
application/problem.  We  will  either  assume  that 

b,(x)  >  bQ  >  0  , 


or  that 


(1.2b) 


(1.3a) 


b^x)  =  b2(x)  =  0  .  (1.3b) 

A  case  of  particular  interest  is  the  indefinite  Helmholtz  equation 

Lu  :=»  -e^Au  -  Sq(x)u,  ®q(x)  >  a  >  0  ,  (1.4) 

2  —2 

(one  usually  writes  this  equation  in  terms  of  k  *  e  )«  On  the  other  hand. 


the  usual  singular  perturbation  problems  have  r  *  0  and  (1.3a)  holds.  In 


this  case  it  is  easy  to  show  that  [4]  there  is  an  eg  >  0  and  for  0  <  e  <  Cq 
the  operator  L  has  a  positive  definite  symmetric  part. 

With  all  this  in  mind,  we  now  outline  the  discussion  in  this  paper.  In 
Section  2  we  discuss  new  results  of  Faber,  Manteuffel  and  Parter  [9]  on  (norm) 
Equivalence  of  Operators.  These  ideas  and  classical  results  of  Nitsche  and 
Nitsche  [15]  and  Drya  [5]  allow  one  to  discuss  preconditioning  of  discrete 
elliptic  operators  without  requiring  positivity.  One  only  requires  that  both 
the  elliptic  operators  and  their  discretizations  be  invertible.  In  Section  3 
we  present  some  ideas  and  results  of  Bayliss,  Goldstein  and  Turkel  [2]  and 
Goldstein  [10]  on  preconditioning  of  singular  perturbation  problems  by  a 
"partial"  multigrid  cycle.  Finally,  in  Section  4  we  discuss  current  work  of 
Goldstein  and  Parter  [12]  on  preconditioners  B*1  so  that 

c ( B~ ^  A  )  =  |B_1A  I.  lA^B  I  (1-5) 

n  n  n  n  n  n 

is  independent  of  n  and  has  controlled,  or  at  least  known,  dependence  on  e* 


2.  Equivalence  of  Operators 

Given  two  linear  operators  A  and  B  on  the  Hilbert  space  H,  we  say 
that  A  is  equivalent  in  norm  to  B  on  the  set  D  C  H  if  there  exist 
0  <  a  <  8  <  “  such  that 

a  <  <  B,  Vx  e  D,  I  Ax  I ,  IBxl  ^  0  .  (2.1) 

RoX  I 

If  A  and  B  are  positive,  self-adjoint  operators  on  H  then,  following 

D'Yakanov  [7],  we  say  that  A  is  equivalent  in  spectrum  to  B  on  DC  H  if 

there  exist  0  <  a  <  3  <  ®  such  that 

o  <  <k— *-  <  8  ,  Vx  €  D,  <Ax,x>,  <Bx,x>  f  0  .  (2.2) 

<Bx,x> 

While  there  are  many  interesting  relationships  between  these  concepts  there  is 
one  striking  fact.  In  [9]  one  finds  a  simple  exanqale  of  an  A  and  a  B  both 


of  which  are  contact,  positive,  self-adjoint  operators  and 

(i)  A  is  equivalent  in  spectrum  to  B,  (ii)  A  is  not  equivalent  in  norm 

to  B. 

Let  Ar  and  Bn  be  two  sequences  of  operators  defined  on  D.  We  say 
that  {A^}  is  equivalent  in  norm  to  {BnJ  uniformly  on  D  if  there  exist 
0  <  a,  S  <  •  such  that 

IA  xl 

a  <  t r2— T  <3/  vx  €  D,  IA  xl,  IB  xl  f  0  .  (2.3) 

IB  xl  n  n 

n 

Or,  we  could  say,  let  Sn  C  D  C  H  be  a  sequence  of  subspace  of  D  and  let 
An,  Bn  be  operators  defined  on  Sn«  Then  Ajj  is  uniformly  equivalent  to 
Bn  in  norm  if  (2.3)  holds  for  every  x  e  Sn» 

Let  A,  B  be  two  invertible  elliptic  operators  of  the  same  order,  say 
2m,  defined  on  the  same  domain  ft  with  homogeneous  boundary  conditions. 
Clearly 

A  :  H2m(ft)  +  L2(Q),  B  s  a2m(ft)  L2(Q)  (2.4) 

where  H2m^  *a  the  So^°^ev  space  of  functions  having  2m'th  derivatives 
in  L2(ft).  In  many  cases  one  also  has 

A**1  :  L2(ft)  ♦  B_1  :  L2(Q)  *  H2m(ft)  *  (2,5) 

When  this  happens 

AB"1  :  L2  ♦  L2,  BA-1  :  L2  ♦  L2  (2.6) 

and  the  operators  A  and  B  are  equivalent  in  norm.  Suppose 
with  A_,  B  defined  on  S_  C  D  C  H  are  discretizations  of  A  and  B.  One 
can  ask,  is  it  possible  to  prove  analogs  of  (2.4),  (2.5)  and  (2.6)7  If  one 
uses  a  finite  element  approach  with  Sn  C  H2m,  then  it  is  easy  to  show  that 
these  analogs  all  hold.  In  the  case  of  finite-difference  discretizations  the 
problem  is  more  subtle.  For  second  order  equations  and  when  ft  is  a 


rectangle  one  can  extend  the  results  of  [15J  to  obtain  an  appropriate 
definition  of  {^(ftth)  and  obtain  estimates  of  the  following  form: 

(i)  Let 

Lu  =  *{Uux)x  +  (bux)y  +  (buy)x  +  (cuy)y}  +  Dux  +  Euy  +  <ju  .  (2.7) 


(ii)  Let  the  boundary  conditions  be  of  the  form 

u  or  ~  =0  on  a  full  side 
3n 


(2.8) 


(iii)  Let  L^u  be  a  standard  finite-difference  discretization  of  (2.7). 

Then,  if  there  is  a  constant  kg  =  kg(L^)  independent  of  h,  0  <  h  <  hg  such 
that  lul^  <  k  ILul.  then  there  are  constants  KQ,  depending  only  on 
the  coefficients  of  L  and  kg  such  that  IL^ul^  <  K. lul 


lull 


H2(£l»h) 


1  "*"H  (fl;h ) ' 

t  2 

<  KglL^ul^  .  Thus,  if  A  and  B  are  two  such  elliptic  operators 


and  {Ar}  and  (Bn)  are  the*r  finite-difference  discretizations  we  have 


IA  B‘V  <  K .  ( A  )  .  Kn(B  )  . 
n  n  in  On 


(2.9) 


At  the  same  time,  since  An,  Bn  are  finite-difference  approximation  to  A 


and  B  we  obtain 


IB_,A  I  -  IA*(B*)“V  <  K.  (A*  )Kn  (B* )  . 

n  n  t2  n  n  1  n  0  n 


(2.10) 


°(b;\)  <  K1<<)K0(An)K1(Bn>K0(V) 


These  results  show  that,  in  the  rectangle  with  boundary  conditions  (2.8) 
one  may  precondition  any  invertible  discrete  elliptic  operator  with  any  other 
such  discrete  elliptic  operator  and  obtain 

(2.11) 

which  is  independent  of  n.  Therefore,  the  important,  and  as  yet  unresolved, 
question  is:  how  to  choose  "good"  preconditioners  and  how  to  measure  the 
"goodness".  Some  preliminary  results  and  ideas  are  presented  in  [9] . 

Remark  1 :  If  one  has  only  Dirichlet  boundary  conditions  one  may  make  a  simple 


extension  of  the  results  of  Drya  (4]  to  obtain  similar  results  when  Q  is  a 


convex,  polygonal  region  whose  sides  have  slope  0,  •  or  ±1  and  whose 


vertices  lie  on  points  of  a  regular  mesh  h  “Ax  *  Ay. 

Remark  2:  While  we  have  not  shown  the  details  here,  an  important  fact  which 
emerges  from  the  analysis  of  [9]  is  the  observation  that  in  these  cases  the 
finite-difference  calculus  allows  one  to  conpletely  mimic  certain  techniques 
of  estimation  normally  used  in  the  analysis  of  elliptic  differential 
operators.  Hence,  in  Section  4  we  will  obtain  all  estimates  in  the 
con$>utationally  easier  case  of  the  continuous  elliptic  operators. 

Remark  3:  Obviously,  equivalence  in  norm  is  transitive.  Hence,  so  is  the 
concept  "the  condition  number  of  (b'^Ajj)  b°un<*ed  independent  of  n". 

3.  Multigrid  as  a  Preconditioner 

In  [2]  Bayliss,  Goldstein  and  Turkel  consider  the  indefinite  Helmholtz 

equation  Au  +  k2a0(x,y)u  =  0  with  a  suitable  radiation  condition  at 

infinity.  After  discretization  via  a  finite-element  method  (and  truncation  of 

the  region)  one  has  a  system  of  the  form  (1.1)  where  An  is  not  symmetric 

(because  of  the  radiation  condition  at  infinity)  and  the  symmetric  part  is  not 

2 

positive  definite  (because  k  >>  1  and  ap  >  0). 

Let  A^  be  the  symmetric  positive  definite  operator  obtained  by  setting 
k2  =  0.  Let  M*1  denote  the  application  of  a  symmetric  "partial"  multigrid 
operator  for  the  solution  of  A^x  =  b  based  on  r  grids.  We  say  a  partial 
multigrid  operator  because  we  do  not  "solve"  on  the  coarsest  grid.  Rather,  we 
only  "smooth"  on  the  coarsest  grid.  Consider  the  preconditioned  normal 
equation 

(M"1An)*(Mr1An)u  “  <MrlAn>*Mr1f  *  (3,1) 

These  equations  are  now  solved  by  the  conjugate  gradient  method.  While  the 
authors  of  [2]  give  no  rigorous  treatment  of  the  effectiveness  of  their 


method,  their  experimental  results  and  heuristic  arguments  are  extremely 
interesting. 

In  [tO]  Goidstein  makes  a  complete  analysis  of  a  simpler  problem. 
Consider  the  operator  Le  given  by  (1.2a)  with  r  =*  1  and  boundary 
conditions  u|gQ  *  0,  where  (1  is  the  unit  square.  The  coefficients  are 
real  and  smooth  and  a^tx)  >  cQ  >  0,  for  i  ■  0,1,2.  Let  L^  be  a  standard 
finite-difference  discretization  of  Le  where  e  ~  ha  with  0  <  a  <  1.  Let 
M”1  denote  the  application  of  a  partial  symmetric  multigrid  for  the  Laplace 
operator  Mu  :  -Au.  In  this  notation  the  subscript  a  reminds  us  that 
Goldstein  chooses  the  coarsest  grid  so  that  hCOarsest  ~  e  ~  ha.  He  now 
solves  this  problem  by  applying  conjugate  gradient  to  the  normal  equations 
^MolLiP * ^MalLh^u  =  ^MalLh^*Mo1^*  In  he  aPP*ies  this  method  to  some 

interesting  applied  singular  perturbation  problems.  In  this  definite  case  he 
shows  that  c^M01ljh)  <  c.]  where  c^  is  independent  of  h  and  el 


4.  General  Estimates 


Let  ft  be  a  smooth  domain.  Let 

2  =  *  ff  | Dau [ 2dx 


ujr  be  the  semi  norm 


|al*r 


(4.  1) 


Let  L  be  a  second  order  elliptic  operator  of  the  form  given  by  (1.2a).  We 
assume  that  the  boundary  conditions  are  homogeneous  and  yield  no  boundary 
terms.  That  is 

.2  rr  rr  .  9u  3u 


//  u [Lu]dxdy  -  e2  ff  [E  a  J^~]dx 

ft  ft  3  xi  j 


+  erE  //  b,  u  dxdy  +  ff  a0u2dx 
3x , 


(4.2) 


Further,  we  assume  the  basic  estimate  of  [15]  holds.  That  is,  let 


with  the  same  boundary  conditions  as  hold  for  L.  Then  there  is  a  constant 
KQ  =  KQ( A)  such  that  |u||  <  K  ILul^  . 

We  remind  the  reader  that  the  estimates  in  this  section  are  for  these 
elliptic  operators.  However,  in  the  case  of  rectangles  or  certain  convex 
polygonal  domains  (with  zero  Dirichlet  boundary  conditions)  these  estimates  go 
over  for  finite-difference  operators.  Moreover,  because  of  the  transitivity  of 
certain  concepts,  (e.g.  "uniformly  bounded  condition  number")  these  results 
also  apply  to  the  partial  multigrid  operators  discussed  in  Section  3. 

Case  1 :  aQ(x)  *  c0  >  0  r  =  1*  (in  (1.2a)) 

In  this  case  we  easily  find  that  there  are  constants  cQ, c.,c2  so  that 


lulT  <  c.ILul 

L.  U  La 
2  2 


(4.3a) 


u  «  <  —  ILul 

'  e  L„ 


(4.3b) 


•  u I  2  <  ~2  '^'l 


(4.3c) 


These  estimates  lead  immediately  to  the  result 
Th eorem  1 :  Let  L,  L  be  two  elliptic  operators  which  satisfy  the  hypothesis 
of  Case  1.  Then  there  are  constants  depending  only  on  the  coefficients 


K1,K2,  but  not  on  e  >  0  such  that 


ILL  I  <  K. 
L2 


(4.4a) 


ILL~ 1 1  <  K,  • 

L2 


(4.4b) 


Case  2:  r  =  0  and  b^x)  >  bQ  >  0. 

Once  c  4  £q,  we  may  assume  that  the  symmetric  part  of  L  is  positive 

definite.  This  is  done  by  setting  u  =  eaxv,  a  ~  0(1).  Hence  we  obtain 

(4.3a),  (4.3b)  and  |u|2  4  (c2/e3) >Lul  . 

2 

Theorem  2:  Let  L,  L  be  two  operators  which  satisfy  the  hypotheses  of  Case  1 

or  Case  2.  There  are  constants  K1#  K2  such  that 

ILL-1 I  4  k^/e,  ILL-1 I  <  k2/e  .  (4.5) 

2  2 


A: 

* 


5} 


Case  3:  aQ(x)  *  “c0  <  ®  and  r  =  1.  We  assume  that  for  this  value  of 
e,  L_1  exists.  That  is,  there  are  constants  cl,c1#c2  depending  on  e  but, 
essentially  of  order  1  and 


lul  < 

L2 


-  .Lu, 
e  2 


Ml  <  "3  ,talL  ' 
e  2 


lul2  < 


-  .Lu, 

£  2 


(4.6) 


Theorem  3:  Let  L  be  an  operator  of  Case  3.  These  are  constants  K.,K2 
such  that 


~  —  1 
HLL 

'l. 

4 

K/e2. 

9LL_1 
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